Missing Release Notes

Amit Dutta

• Fix spell in ValidateStreamingAggregations. #17247 Fix spell in ValidateStreamingAggregations. (Merged by: Timothy Meehan)
• Throw proper error code when timezone is invalid during from_unixtime execution. #17241 Throw proper error code when timezone is invalid during from_unixtime execution. (Merged by: Timothy Meehan)

Nikolay Laptev

• A simple sql to sql rewrite for cardinality() #17198 A simple sql to sql rewrite for cardinality() (Merged by: James Sun)

Pedro Sereno

• fix deltalake docs sql query render #17242 fix deltalake docs sql query render (Merged by: Rongrong Zhong)

Extracted Release Notes

• Extend avro reader to support more primitive types #16280 (Author: Yang Yang): Extend avro reader to support more primitive types
  • Extend avro reader to support more primitive types.
• upgrade pinot lib to support new features introduced in Apache Pinot 0.9.3 #17015 (Author: Xiang Fu): upgrade pinot lib to support new features introduced in Apache Pinot 0.9.3
  • Upgrade to support Pinot version 0.9.3.
  • Support Pinot TIMESTAMP and JSON types.
• Support any expression for dynamic filtering probe side #17169 (Author: Zhenxiao Luo): Support any expression for dynamic filtering probe side
  • Dynamic filtering support for right join.
  • Support any expression for dynamic filtering probe side.
• Add a quicker, hash-based version of distinct limit #17199 (Author: Sreeni Viswanadha): Add a quicker, hash-based version of distinct limit
  • We now have a faster version of distinct limit N queries for N <= 10000 that uses distinct hashes for quicker results to handle common situations where there are a few dozen distinct values in large datasets. This feature can be enabled by session param: hash_based_distinct_limit_enabled and the limit (default 1000) can be adjusted using: hash_based_distinct_limit_threashold.
• Parquet predicate improvements #17217 (Author: Zhenxiao Luo): Parquet predicate improvements
  • DefuncConfig: hive.parquet.fail-on-corrupted-statistics. Always fail on corrupted parquet statistics.
• Add last_day_of_month function #17219 (Author: ericyuliu): Add last_day_of_month function
  • Add :func:last_day_of_month UDF to return the last day of the month.
• Consolidate iceberg native-mode into the catalog type #17233 (Author: Chunxu Tang): Consolidate iceberg native-mode into the catalog type
  • Remove the native-mode iceberg config. Use catalog.type instead.

All Commits

• c47ed3f Move SqlFunctionExecutor to SPI (James Sun)
• eb5712d Reverse the dependency between function manager and grpc (James Sun)
• a9c921f Abstract SqlFunctionExecutor (James Sun)
• abd40ba Fix spell in ValidateStreamingAggregations (Amit Dutta)
• efd857f upgrade pinot lib to support new features introduced in Apache Pinot 0.9.3 (Xiang Fu)
• 1dbfc9d remove max initial split from hivesplitmanager constructor & improve fragment cache hit ratio (zhangyanbing)
• 1885f64 fix deltalake docs sql query render (Pedro Sereno)
• e580d20 Release dictionary memory on Stripe flush (Arunachalam Thirupathi)
• 2937720 Account for nulls in DictionaryCompressionOptimizer (Arunachalam Thirupathi)
• b1cdf21 Exclude guava dependency from io.grpc (James Sun)
• a88fd7c Throw proper error code when timezone is invalid. (Amit Dutta)
• 41329cd Update module versions (Rongrong Zhong)
• 655011c support grpc udf (wangjingdong)
• fac513e Add last_day_of_month function (ericyuliu)
• f91d2f6 Consolidate iceberg native-mode into the catalog type (Chunxu Tang)
• 869562e Pass credentials in SqlFunctionProperties (Pranjal Shankhdhar)
• 37e3cc0 Remove iceberg supported testing placeholders (Chunxu Tang)
• 85d6e26 Upgrade log4j to get rid of CVE-2021-44228 (chuxiao)
• 15d790b Disable testOuterJoinWithExpression test (James Sun)
• 1534f87 Merge dynamic filtering tests (James Sun)
• 8c2757a Extend avro reader to support more primitive types (Yang Yang)
• 7c3db27 DefuncConfig: hive.parquet.fail-on-corrupted-statistics. Always fail on corrupted parquet statistics (Zhenxiao Luo)
• c205dc6 Speed up construction of parquet predicate from dictionary (Zhenxiao Luo)
• e666700 Add a quicker, hash-based version of distinct limit (Sreeni Viswanadha)
• 2d0e663 Add end to end test for dynamic filtering support in right join (Zhenxiao Luo)
• 6aa1f73 Support right join for dynamic filter and any expression for probe side (Zhenxiao Luo)
• 56ebb75 Simplify PlanVariableAllocator loop (James Petty)
• af84cc8 Simplify cardinality on map keys and values functions (Nikolay Laptev)
• 749d43a Pinot connector: Fixing extra grpc metadata config (Xiang Fu)
• 689a2f1 Prohibit LIMIT clause in materialized views (Pranjal Shankhdhar)